Vox Populi Annotation: Measuring Intensity of Ideological Perspectives by Aggregating Group Judgments
نویسندگان
چکیده
Polarizing discussions about political and social issues are common in mass media. Annotations on the degree to which a sentence expresses an ideological perspective can be valuable for evaluating computer programs that can automatically identify strongly biased sentences, but such annotations remain scarce. We annotated the intensity of ideological perspectives expressed in 250 sentences by aggregating judgments from 18 annotators. We proposed methods of determining the number of annotators and assessing reliability, and showed the the sentence-level annotations on ideological perspectives were reliable across different annotator groups.
منابع مشابه
The Wisdom of Crowds (Vox Populi) and Antidepressant Use
Under certain conditions, groups of people may (collectively) make better judgments than experts. Galton connected this phenomenon to the phrase vox populi in a 1907 paper. Arguably, an example of the phenomenon may be found in recent stabilization of the frequency of antidepressant use, following decades of increases. There is no evidence that a change in physi-cian behaviour has caused this s...
متن کاملVox Populi: An Interactive Evolutionary System for Algorithmic Music Composition
While recent techniques of digital sound synthesis have put numerous new sounds on the musician’s desktop, several artificial-intelligence (AI) techniques have also been applied to algorithmic composition. This article introduces Vox Populi, a system based on evolutionary computation techniques for composing music in real time. In Vox Populi, a population of chords codified according to MIDI pr...
متن کاملVOX POPULI: Automatic Generation of Biased Video Sequences
We describe our experimental rhetoric engine Vox Populi that generates biased video-sequences from a repository of video interviews and other related audio-visual web sources. Users are thus able to explore their own opinions on controversial topics covered by the repository. The repository contains interviews with United States residents stating their opinion on the events occurring after the ...
متن کاملA new approach to relevancy in Internet searching - the "Vox Populi Algorithm"
In this paper we will derive a new algorithm for Internet searching. The main idea of this algorithm is to extend the existing algorithms by a component, which reflects the interests of the users more than existing methods. The “Vox Populi Algorithm” (VPA) [1] creates a feedback from the users to the content of the search index. The information derived from the users query analysis is used to m...
متن کاملMedical marijuana, compassionate use, and public policy: Expert opinion or vox populi?
Spend your few moment to read a book even only few pages. Reading book is not obligation and force for everybody. When you don't want to read, you can get punishment from the publisher. Read a book becomes a choice of your different characteristics. Many people with reading habit will always be enjoyable to read, or on the contrary. For some reasons, this medical marijuana compassionate use and...
متن کامل